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Method for providing an Interaction in an electronic device and an electronic 
device 

The present invention relates to a method and a device for providing an interaction 
5 and paxiicul4rly. for providing a laclile inleraciiou in an ebctfuxilc device, 

DackiT-ound of the invention 

Traditionally the user controls die device by pressing keys or other controls located 
10 on a limited area on the surface of the device. I'he system response is presented in 
graphical display. This type of user interface is not very usable e.g. in the following 
case??. Tf the rif^virp, ifs very small with small Icftys in th^ keyhnard and the user has 
thick gloves in his/hers hand, there is no access to keys. If the device is very small 
with a small display and there is limireri sight or rhe user does not wear glasses, it is 
1 5 difficult for the user to have access to the display. 

In US patent 6,466,198 provides a system and a method for view navigation and 
magnificalion of rhe display of band-held devices in response to the oileniaiion 
chnnges along only two axes of rotation as measured by sensors inside the devices. 

20 TTie view navigation system is engaged and controlled by a single hand, which 
simultaneously presses two ergonomically designed switches on both sides of the 
hand-held device. In other embodiments, the system engaged iuiu the view 
navigation mode in response to an operator command in the form of a finger tap, or 
a voice conunand, or predeflned user gestures. The response uurvc of die view 

25 navigation to sensed changes in orientation is dynamically changing to allow coarse 
and fine navigation of the view. Various methods are described to icrimiiaie the 
view navigation mode and fix the display at the desired view. Miniamre sensors like 
accelerometex's, tilt sensors, or magneto-resistive direction sensors sense the 
orientation changes. The system can be added to an existing hand^heid device via an 

00 application interface of the device. 

There is no direct access to the keys or the display if the device is wearable or in a 
pocket or a hag. There are also many situations where die users attention is in other 
task than controlling the device: communication through the device, or the 
35 enviromnent may lenapoimily require attention. 
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Summary of the invention 

The preseni invention describes a solution for InLeraciion wiili UaadJiclJ or wearable 
device by providing ax least some limited control of the device other than e.g. 
5 pressing a specific key in the keyboard. The metliud uf Ujc present Invention is a 
combination of using a motion sensor tuned for sensing the control action (e g. a 
tap) of ilie user ajid tactile feedback pulse signal, which is perceivable in a wide 
range of conditions. 

10 Specific gesture, a tap or multiple taps, is used for controlling the device. Motion 
sensoi (3 dimensional accelerometer, for example) is tuned to detect the tap on the 
surface of the device, l ap in any dn-ecnon and position on thR 5;urrace of the device 
is detected. Tccdback from the device is provided by tactile means. Vibrating alert 
achiarnr is usRri tn givp- n pulse That vibrates the device. This vibration can be felt 

15 also in most difticult cases. After the tap the user can hold his/hers hand in the 
Innarion of tht*, rlftvicp., or prasiR ihe device closer to his/hers body» in order to 
provide his/hers attention as a response. Visual and audible perception can also be 
c1ire^.tecl to the environment or in rhK cnmmnnication ra.slc. 

20 The present invention enables for the user successful use of die device in e.g. 
temporarily difficult situations, especially with limited access to controls and 
display or when tradirional methods (visual or audible uiciliods) ai*c not possible to 
use. The mtention of the present invention is to enhance the interaction to new, 
more sophisticated level. 

25 

According to a first aspect of the invention a method is provided fox providing an 
interacdon between a user of an electronic device, and the electronic device, said 
device uuinpri^iing au usei iiiteiface ajad a motion sensor capable of detecting three 
dimensional motion, characterized in that tlie method comprising the user providing 
30 a gesture by couching die device, said gesture comprising at least one component of 
the three dimensions, the device detecting said gesture and providing a feedback in 
lespouse to said gesture detecrion. 

According to a second aspect of the invention an electronic device is provided for 
Hfj prnviriing interaction between to a user of said elecironic device, said device 
comprismg an user interface and a motion sensor capable of detecting three, 
dimensional motion, characterized in that the device comprises; detecting means for 
detecting at least one touch of die user touching the device, said gesture comprising 
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at lefeLSl uue cuiiipuiiciit of die diree dimensions, feedback means for providing a 
feedback in responfie to said detected gesture. 

According to a third aspect of the invention a cnmpnter program product is provided 
5 for aa electronic device for providing interaction between to a user of said 
electromc device, said devine comprising an user interface and a modon seizor 
capable of detecting three dimensional motion, characterized in that the computer 
program product comprises; r.ompnrer program code for causing the device to deiccL 
at least one gesture of the user touching the device, said gesture comprising at least 
10 one component of the three rlimRn<;Tnns, compmer program code fur caujiiug the 
device to provide a feedback in response to add detected gesture. 

In the following, the invendon will be described in greater detail with reference to 
the accompanying drawings, in which 

15 

Figure 1 illustrates a flow dlagi^am of a method accuiiUug to an embodimcni: of the 
invention. 

Figure 2 illustrates a flow diagram of a method according to another embodiment of 
20 ilie itiventiun, 

Figuie 3 illusuates a block diagi'am of an electronic device according to an 
embodiment of the invention and 

25 Figure 4 illus urates a communication devint?: according to an embodiment of the 
invcuLiuii. 

Detailed description of the invention 

30 Figure 1 illustrates a flow diagram of a method according to the first embodiment of 
the invention. The sre.ps nf ihe method can be impkjncaied for example in a 
computer program code stored in a memory of an electronic device. When 
explaining this method a reference has been made lu die device 300 being illustrated 
in figures 3 and 4. 

35 

At step 101 the process begins, e.g. the device is starred up and a menu structure is 
provided visually in a Jibiplay of die device. At step 102 a signal from motion sensor 
314 is received. At step lOlH it is detected whether there is a delectable tap or not. 
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Fur example the duraiion and/or ihe imensiiy of the signal tells if there Is tap in 
question or was the device dropped on the floor. If there was no tap at step 103 the 
flow proceeds to step 102, If there was a tap at step 103, the amount of taps is 
counted at step 104. If the tap or taps were tapped on the X axis at step 105 as 
5 ahuwu in figure 4, che flow proceeds to step 106, wherein an operation relacing to 
the X tap or taps is performed. Next a tactile feedback is provided at step 107 to the 
user of die device by aid of a vibrator 315 aii illusUaLul in figure 3, Similarly, if die 
tap or taps were tapped on the Y-axis at step 108 (or Z-axis at step 11 1) as shown in 
figure 4, tlie flow proceeds to step 109 (or step 112), whcit;iu a operaiioii rclaiiag to 
10 the y tap or taps is performed. Next a tactile feedback is provided at step 110 (or at 
step 1 13) to the user of the device by aid of a vibraiur 315 illusliaicd in figuie 3. 

Figure 2 illustrates a flow diagram of a metl^od accordijiA to the second embodiment 
of the invention. The. steps of the method can be implemented for example in a 

15 computer progr2Lm code stored in a memory of an electronic device. When 
explaining this method a reference has been made to the device iOO being illustnitpd 
in figures 3 and 4. In this exemplary illustration, there is a speed dial register 
comprising four fe.lephone mimbers wirh names stored in rhp. memory of the; device 
300. "dial r for name "Ronja" and for number "0400 123456", "dial 2" for name 

20 "Olli** and for number **040 7123453", "dial 3" for name "Aapo" and for number 
"041 567890", and finally '^dial 4" for name **Henri'' and for number "0500 
8903768". 

At Step 201 the process begins, e.g, the device is staned up and a menu structure is 
25 provided visually in a display of the device. Let us now assume that the user of the 
device is going to make a phone call to Henri ("dial 4"). First he/she selecUs Qic 
number being used, as illustrated in the following. The user of the device 300 taps 
fOLu Limes. At step 202 a signal [ivm a uiulion seusoi 309 is detected. At step 203 it 
is detected whether there is a detectable tap or not. For exanq^le the duration and/or 
30 the iiiteiisity of llic signal tells if tlieie is a cap ia question or was the device dropped 
on the tloor. It' there was no tap at step 2U3, the Irlow proceeds to step 202. If a tap is 
detected at step 203, it is jicxt determined at step 204, whetlicr a call is in progress 
or not. If there, is no call in progress at the moment, the flow prnneteds tn step 205, 
wherein the taps are counted by e,g. a counter, 

35 

At steps 206 210 it is checked whether there was/were only one tap (step 206), a 
double tap (step 207), two taps (step 108), three raps (step 209) or four taps (step 
210)- In this example the user tapped four times, therefore the flow next proceeds to 
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step 215 in order to select "dial 4" from ±c fast dial register. Next at step 220 the 
device forms a tactile feedback to the user by aid of a vihraror 31.1, in order to 
confimi the user that "dial 4" is now selected. The feedback can be for example four 
vibration pnlsf^s (duration e.g. 20 m<). 

5 

After i:hat there are two alternatives to progress. In ilie first alternative after Uie 
feedback is produced at step 220, the device can make automatically a 
comTnunicarion connection to ^'Henri" and to number "0300 8903768" and the How 
proceeds from step 220 to step 202. 

10 

In the second alternative the flow proceeds to step 202 as described above, wherein 
a signal from the motion sensor 314 is again wailed. The next iliiuA tlie user now 
has to do is to activate the phone call by giving e.g, a double tap. The device detects 
the double Lap (steps 203-207) and acLiyalcs die selected number (step 212). Next 
15 the flow proceeds to step 217, wherein the device produces a tactile feedback in 
order to iiifonn the user about confirJixaLiuu of the activation. TLic feedback can be 
e.g. a single shake, or a longer lasting vibration pulse, e.g. five times as xniir.h a.s the 
vibradon of one single vibrdUuJi puke. 

20 Wlten the user wants to end die phone call, he/she just taps twice (in this example) 
the device in order to terminate the phone call. Ihe devicft detects ar step 203 first 
tap, at step 204 it is also detected that the phone call is in progress and the flow 
precedes to step 22 J, wherein the taps are coiinrRd. Tf vwo taps are delected at step 
221, the flow proceeds to step 222, wherein Uic call is terminated and finally the 

25 ending of the call is confirmed tn rhe met with a vibration (step 223). After slep 223 
the flow proceeds to step 202. 

Regarding to sxcps 206-210, the device detects die difference of taps e.g. as 
evplainpri in the following. When the fu'st tap is detected a counier in die device is 
30 reset (7=0) and it steals to count time (T=T+1), Let us assume here that one umt of 
rime here if; one milli.second (ms). If the next lap is delected in less dian e.g. 200 ms, 
then a double tap is detected. If the next cap is detected in more than said 2UU ms but 
in less than e.g. 4000 ms, dien two laps is dctccicd. 

35 It is lo be noied thai Uic liicQiod according to tlic invention is not restricted to the 
examples as illustrated above. It is evident that other implementations are possible 
ciJ> well, E.^;. die following examples can become in qucsdon; a phone ia in a bag or 
pocket and a user want.s to f;ilent a disturbing incoming call alert and/oi soft rejects 
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Ulc cfeill (uiie or severdl Laps), The user wants to enable spcecli recognition coatiol, 
A tap activates the control and a vibration pulse or pulses (e.g. 5 pulses) confirm 
aeiivaiiou. A double lap can aciivaie aji erucrgeuuy call. A siijigle tap can activate a 
volume control for headset, a vibration to confirm said aciivadon and fiirtliex taps to 
5 increase or deciease tlie volume level. Fast foiwaid (one tap) or fast rewind (two 
taps) lor e.g. 5 seronds in voice messages. Kirthermore, tap control cm he 
combined with other gestures or control means, e g. cap enables shakc/tilc gesture 
input for next 2 seconds time. 

10 Figure 3 ilJustrates a block diagram of an elerironic device 300 nccnrrting lo an 
embodiment of the invention. The device comprises a processor 301 and a memory 
302 for processing the operations being performed in the device 300. The device 
can also comprise a storage medium 303 for storing applications and information, 
e.g. Phonebook 304, Games 305, a speed dial register 306 and messages 307, like 

IS SMS ond/or MMS messages. The device further comprises a keyboard 308 and a 
rii?;pLiy 309 for inputting and outputcing information from and to the user of Qie 
device. The device 300 is connectable to a communication network and/or to 
another devices by means of a transceiver 310. an antenna 311 and an Inpui/Ouiput 
means 313 e.g. an infrared connection or cable connection, such as an USB-, Blue 

20 tooth. Serial- or Fire Wire cunueciiuu, fur cAaniple. Tlie device 300 further 
comprises a motion sensor 314 for delecting motion, e.g. a tap and/or a gesmre 
made by the user of the Ueviuc. The motion sensor 314 is capable of detecting 
motion in at least one durection of at least one of the X, Y, or Z-axis as illustrared in 
figure 4. The motion sensor 315 caji be capable of detecting motion to all six 

25 directions as illustrated in figure 4 (X, -X, Y, - Y, Z and -Z direxitions) 

The device 300 is a wireless conmiunicaiion device, snr.h as a mobile telephone 
operating in a communication system such as GSM system for example. The device 
can be further or alternatively a portable game r.nnsnle capable of providing to ihe 

30 user games stored in the device 300. For example the user can move a game cursor 
on the display of tlie mobile phone by tapping one of the sides of the mobile 
telephone. The user can accept his move for example by mpping the front of the 
mobile phone. By aid of transceiver 310 and antenna 311 or Inpui/Outpui mcaus 
313 it is possible to connect the device 300 in communication connection with one 

35 or several odier game console devices in order to play network games. 
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Figure 4 illusiraies a conununicaiiun device auuuidiug to aii embodiment of the 
invention. The figure illustrated the device 300 and a three dimensional coordinate 
system with Y- and Z-axis. 

The abuvc disulusuic illusliates rhe iaiplementanon of the invention and its 
embodiments by means of examples. A person sJdiiexl in the art will find it apparent 
that the invention is not restricted to the details of the abovc-dcscribcd embodiments 
and that there are also other ways of impiemejiimg the invention withnnr deviating 
from the characteristics of the invention. The above embodiments should dius be 
considered as illustrative and not resrriotivp.. Hftnce the possibiliiies of 
implementing and using the invention arc only restricted by the accompanying 
claiins and themfore the different alternative implementations of tlie invention, 
including equivalent implementations, dcfmed in die claims also belong to the 
5;cnpe of the invention. 
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Oalins 

L A method for pioviduift an inteAaction bctwccm a user of an electronic device 
and the electronic device, said device comprising an user inierface and a 
5 motion sensoi (314) capable of deiectin.^ du'cc dimensional motion, characterized 
in that the method comprises 

- the user providing a gesture by touching the device, said gesture comprising at 
least one component of the ihre^. dimensions^ 

- the motion sensor (314) of die device (300) dciccdng said gesture and 

10 - The dRviee. ("^00) prnviriing feedhacTc in response lo said gesture deteciion. 

2. A inethod according to claim 1, characterized in that said gesture selects a 
function of the device. 

15 3, A method according to claim 1, characterized in that said gesture activates a 
function of the device. 

4. A method according to claim 2 or 3, chamclerixed iu lliat said function is a 
scroll of a list in the user interface of the device. 

20 

5, A method according to claim 1, characterized in that said gesture moves a 
gaait^ cursor on diu display uf die device in two dimensions. 

0. A method according to claim 5, characterized in that a further gesture in a 
25 third dimension of the device accepts the move made by the user in two other 
dimensions. 

7. A method according to claim 2, characterized in diat said selection is 
continued by said feedbaclc. 

30 

8. A method acrnrding to claim 3, characterized in that said activation is 
confirmed by said feedback. 

9. A method according to claims 7 and 8, characterized in that said feedbaclc is 
35 ai least one of the following: a tactile feedback, an audible feedback or a visual 

feedback. 
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10- All elccuonic device (300) fot providing interaction between a user of said 
electronic device, said device comprising an user interface and a motiOTi Rftnsnr 
(314) capable of detecting tlirec dinicnsional motion, characterized in that the 
device comprises 

5 - dclccaii^ uicaiis (301, 302, 314) for detecting a gesture comprising at least one 
component ot the three dimensions which geshira is provided by at least one touch 
of the user 

-fftftdbanic mean?? (301. 302. 3 IS) for providing a feedback in response to said 
detected gesture. 

10 

11. A device according to claim 10, characterized in that said detecting means 
are arranged to select a function in response to said detecied geiilurc. 

12. A device according to claim 10, characterized in Ihat said dcicuUug means 
IS are arranged to activate a function in response to said detected gesture. 

13. A device according to claim 11, characterized in that said feedback means 
are arranged to inform the user about the courinuatiuij of said selection- 

20 14, A device accuiiliiig to claim 12, chai-acterized in that said feedback means 
are arranged to inform the user about the confirmation of said activation. 

15. A device according to claims 13 and 14, charncTi^ri7ed in thai said feedback 
means are aiTangcd lo provide at least one of the following feedback: a tactile 

25 feedback, an audible feedback or a visual feedback. 

16, An electronic device according to r.l^Jim 10, characterized in chat said gcsLLur 
is arranged to move a game cursor on the display of the device in two dimensions. 

30 17, A method according to claim 16, characterized in that a furdier gesture in a 
third riimeTision of itie device is arranged lu accept die movement made by the user 
in two other di mcnsions . 

18. A device according to any of claims 10 to 17, characterized in that said 
35 device is ai least one of the following: a portable game console or a wireless 
communication device. 
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1.9. A cufJipuLer prugraiu pioduci for an electronic device (300) for providing 
interaction between a user of said electronic device, said device comprising an user 
interface and a niuCiuii sensor (314) capable of deiecciiift dircc dimensional motion, 
characterized in that the computer program product comprises 
5 - computer program code for cauiiiug the device to detect at least one gesture of the 
user touching the device, said gesture comprising at le^sr nne component of the 
three dimensions, 

- computer program code for causing the dp.vicp, tn provide a feedback In response 
to said detected gesmrc. 
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(57) Abstract 

A meihod aiid a device rui piovldinje; an interaction 
between a user of an electronic device^ and the eiecironic 
device, said device comprising an user interface and a 
motion sensor capable of detecting three dimensional 
motion. In the method; tlic user provides a gesture by 
touching the device, said gesture comprising ^^t Iftasr one 
component of the three dimensions. The device detects said 
gRstiiTfi and provides a Tactile feedback in response 10 said 
gesture detection. 

Figure lb 
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